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I. INTRODUCTION 


In the past 35 years, thousands of papers have been 
published dealing with decision theory and optimization. 

In the development of that theory, the study of solutions 
to systems of linear inequalities has played a large role. 
The importance of mathematical models as tools in decision- 
making has motivated increased interest in that theory 

and its implementation. 

Linear programming is the minimization of a linear 
function subject to linear inequality constraints [Ref. 1]. 
The techniques applied to this area of optimization are 
rooted in the theory of solutions to systems of linear inequali- 
ties and the mathematics of linear equation theory. Appli- 
cations of this theory provide insight into the problem of 
minimizing a convex function whose variables must satisfy a 
system of convex inequality constraints. The applications 
also provide a framework for extending problems in mathe- 
matical statistics and a foundation upon which are built 
modern algorithms for the solution of optimization problems 
whose variables are integer valued (integer programming) 
or whose constraints are non-linear (non-linear programming). 
Due to this wide range of applications, the availability of 
efficient implementations of linear programming algorithms 


has become important. Routines to solve a wide variety of 





problems have been developed for use on mainframe computers. 
Many competitive businesses and industries routinely rely 
On such programs to assist in day-to-day corporate decision 
making. These systems tend to be expensive to operate due 
to overhead costs associated with the operation of large- 
scale computer hardware and the training of operators of 
time-share systems. 

The microcomputer is fast becoming a viable alternative 
to time-share mainframes as a source of computational power 
for small businesses and individuals. Rapid advances in 
computer technology, especially in micro-electronics, have 
made possible the routine use of many of the basic, theoreti- 
cal algorithms which were previously viewed as too complex 
and inefficient. The incorporation of these advances into 
the manufacture of "micros" and the development of micro- 
computer-based programming languages responsive to user 
needs have only recently allowed for implementation of 
fundamental optimization tools on the relatively inexpensive 
microcomputer. Obvious trade-offs arise in the comparison 
of "micros" to mainframes. While the speed at which large 
computers accomplish computational results is surely their 
greatest asset, so are size and the costs of hardware and 
software their greatest liabilities. On the other hand, 
the relatively inexpensive one-time purchase price of 
the microcomputer and its associated software must be 
somewhat offset by its slower computational speed and smaller 


memory size. 
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Another disadvantage of the microcomputer is that effi- 
cient, "user-friendly" optimization systems are not cur- 
rently available for the microcomputer environment. This 
is possibly due, in part, to the intense effort required to 
develop sophisticated microcomputer software in this severely 
restricted environment. While a few basic implementations 
of linear programming optimization theory are beginning to 
appear, no reference to any work of consequence has been 
found in the literature. Further, it is not clear that the 
advantages of the microcomputer have been fully exploited 
in those few systems currently being released. In fact it 
1S apparent that so-called microcomputer asa systems are 
usually weaker versions of systems designed and implemented 
for mainframes from simple textbook descriptions and modi- 
fied for use on a microcomputer; the elementary theory 
incorporated limits problem size and solution efficiency 
due to insensitivity to the strengths and weaknesses of the 
target computer. Few of the sophisticated features of widely 
available commercial, mainframe optimization systems have 
been transferred to "micros". 

The following is an attempt to amalgamate current 
technology and fundamental theory regarding linear pro- 
gramming and to create an easy-to-use, interactive computer 
program with wide applicability on current state-of-the-art 
microcomputers. The system described is designed for a most 


restrictive "eight-bit" microcomputer in the hope that 
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upward compatability with larger machines and new-generation 
computers will allow more advanced capabilities as technology 
admits in the future. The algorithms described and imple- 
mented range in complexity from simple algebraic manipula- 
tion, as in the simplex pivot, to the more involved technique 
of the preassigned pivot procedure initially developed by 
Hellerman and Rarick [Ref. 2]. Subtle modifications have 
been made to many of the basic algorithms to allow implemen- 
tation on the microcomputer. Other algorithms have been 
embedded in the code and are activated where required, e.g., 
a new modification of Bland's first rule for the avoidance 
of cycling in the presence of degeneracy [Ref. 3]. In the 
section dealing with the use of the program, the input and 
output routines are discussed. 

The package employs a reasonable number of "large- 
scale" optimization features, including sparce problem repre- 
sentation and product form inverse. The limits on the size 
of problems that these programs can cope with is principally 
dependent on the size and bit density of the off-line stor- 
age available and the size of internal random access memory 
(RAM). Numerous vectors are implemented whose dimensions 
are problem dependent and allocated at run-time, providing 
true dynamic dimensioning. "In core, out of core" operation 
maximizes RAM utilization ina fashion reminiscent of second 
generation mainframe computers two decades old. 

JRT Pascal version 3.0 is used to implement the theory 


discussed in this thesis. The program modules are compiled 
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on the KAYPRO II, elight-bit microcomputer. The associated 
algorithm is designed based on speed (number of calcula- 
tions required), overhead required, available programming 
language constructs, and simplicity of theory; usually in 
Emat Order. 

Wide-spectrum stress testing of the package has not 


been performed due to time constraints. 
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IIT. PROBLEM REPRESENTATION 


In this chapter we define a canonical problem format 
(LPC) and the terms to be used throughout the development 
of the algorithm. We then show that, given any problem formu- 
Pation, (LPF), an equivalent, canonical form may be achieved 
through the application of simple transformations and/or 
the introduction of additional logical variables such that 
a sOlution to (LPF) can always be constructed from an 
equivalent solution to (LPC). 


Any linear program is formulated as follows: 


(LPF) Minimize (or maximize) cx 
subject to linear equality or inequality 


constraints with variables, 


me Zan non-negative, 
= < 0 non-positive, or 
Me unrestricted in sign ("free"). 


A. CANONICAL FORM 

The algorithm developed in this thesis is designed to 
provide optimal solutions to linear programming problems 
stated in the following "canonical" form (assuming an opti- 


mal solution exists): 
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(LPC) IMgaImize cx ("objective function”) 


subject to 


Ax = b, ("constraints") 
Os as Ue (UB are "upper bounds") 
5 eg AIG ("non-negative right 


hand side") 


where xX 1S an n-dimensional column vector, c is an n- 
dimensional row vector, A is an mxn matrix of technologi- 
PemeecOecrri1cients with n > m, and b is an m-dimensional 
column vector. All (LPF) forms may be converted to the 


(LPC) form as described in the following sections. 


ee BASIS DEFINITION 

A basis, denoted by B, is any set of m linearly 
independent columns of A. An initial basis, Bos is the 
first basis considered in the iterative solution of (LPC). 
It will be convenient to construct an initial basis, during 
the process of transforming (LPF) to (LPC), such that 


eas Tmetial basis consists of unit vectors, 1.é., By as ie 


In so doing, the inverse of the initial basis, eae is 


identically I and its "product-form", the implicit repre- 


sentation of Bae as the product of elementary transforma- 


tion matrices, is trivial. 
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C. MAXIMUM VS. MINIMUM 


Suppose that the problem (LPF) is stated as: 


maximize cx 
Sede. 


Canonmccdimerormn (Lec) meonstraints. 


Since (LPC) requires formulation as a minimization 
it will be necessary to transform the objective function, 
maximize cx. The resulting, equivalent minimization 


igaecelon is: 
minimize (-c)x; we redefine c accordingly in (LPC). 


eamilarly, for each b, < 0 we can perform a transforma- 


tion to replace with b. > 0 as follows: 


a. multiply row 1 by -l. 


mee ceplace the right hand side element so that 


D. SLACK LOGICAL VARIABLES 

We must be concerned with transforming inequality 
constraints to the canonical form. Consider the (LPF) 
Peopvem with the “ith” constraint of the following form: 


esate cL 


1 32% Estes. oF Jae. x — o—— 


Ail Z aig 7.8 
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Berconvyere Enis problem to canonical (LPC) form we 


mewratce the constraint as follows: 


where the non-negative variable, Sis introduced is referred 
Memes a “Slack variable”, or "logical plus type". Note 
that if some x satisfies the (LPF) constraint, it also 
satisfies the (LPC) constraint and vice versa. The slack 
variable simply takes on the value required to maintain 


the equality in (LPC). 


E. SURPLUS LOGICAL VARIABLES 
Suppose that the ith constraint from (LPC) is of the 


EOom : 


then 


a... 


+ a..X,. + ... ta. X cw. = 6), wa > O- 
aa 1 ’ a 


DP) Heig tine! a a aie 


The Wi variable appended here is called a "surplus 
variable" or "logical minus type" and again, any x satis- 
fies the (LPF) form if and only if it satisfies the (LPC) 
form. Here Ws takes on the value required to maintain 


the equality. 


Jey! 





F. ARTIFICIAL VARIABLES 

Considering the introduction of the variable, w, into 
(LPC) for the previous case, we find that its coefficients 
form the negative of the i-th unit vector. We would prefer 
to have available an initial basis composed exclusively 
of positive unit vectors. By construction we will add a 
second, non-negative variable to the previous equation as 


follows: 


The variable introduced is called an artificial varia- 
ble. Note that Zs > 0 in (LPC) implies that the i-th 
constraint in (LPF) is mot satisfied. However, if a solu- 
tion to the new problem can be found such that i 0, then 
the solution to the new problem will be consistent with 
the solution to (LPF). 

By similar convention we introduce an artificial varia- 
ble into equality constraints of (LPF) to produce an initial 
identity basis for (LPC). Note that the values of artificial 
variables in (LPC) gauge the magnitudes of respective con- 


Straint violations in (LPF). 


G. VARIABLE BOUNDS 


Variable bounds are elementary constraints of the form 


ape 





Frequently, such constraints are present in (LPF) and can 
be expressed aS variable bounds in (LPC) . Variable bounds 
are accommodated with great efficiency in the bounded 
variable simplex method, but they must be identified 
Peaeeicitly prior to the solution. 

As a further simplification, the lower variable bounds 
may be changed to be zero by the simple transformation 


(change of origin): 


Recovery of the final solution to (LPF) from a solution to 


(LPC) is immediate by reversing the transformation: 


(EP Eee - (EPC) 


H. VARIABLES WITH UNRESTRICTED SIGN 
An easy technique available to deal with "free", or 


"unrestricted variables" replaces the free variable with 
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the difference of two non-negative surrogates, i = He = Wa 
Although this technique introduces an additional variable, 
the overhead cost is only the duplication of the coefficients 
of x to create the additional variable, and a final trans- 
formation to recover the resulting value of Kas which is 
relatively inexpensive. Storage overhead for the new 
variable is of little consequence due to the use of the 
"out-of-core" storage of non-zero problem elements. 

All complications in (LPF) may now be handled by standard 
elementary problem transformations to produce (LPC). Thus 
X may be unrestricted in sign, and arbitrary inequality 


constraints can be accommodated so that any formulation may 


be easily modified to produce (LPC). 
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III. ALGORITHM SELECTION 


Once the problem formulation has been transformed to 
Canonical form (LPC), an algorithm must be developed, or 
adapted, that provides the technique required to solve 
the (LPC) problem. This algorithm must be both efficient, 
and sympathetic to the eccentricities of the small computer. 
In keeping with common practice on microcomputers, we adopt 
a straightforward, elementary textbook approach to the 
mathematical justification of our simplex algorithm. The 
implementation 1s necessarily more sophisticated. The 
general algorithm that will be discussed here is the two- 
phase, revised simplex method (simplex method using multi- 
pemers) [Ref. 1]. Specifically, the non-zero elements of 
the product form of the inverse and all non-zero problem 
elements will be stored in two random access diskette files 
and will be read into internal memory only when required. 
The associated reinversion technique used is the preassigned 
pivot procedure [Ref. 2]. Each section of the algorithm 
will be discussed in this chapter. The next chapter will 


be devoted to the associated implementation. 


A. A GENERAL SIMPLEX TECHNIQUE 
Assuming that the problem statement has been transformed 


to the form of (LPC), we may proceed as follows: 


PAA 





l. Rewrite (LPC) in Terms of Basic Solution 
At any iteration; let B be a set of m linearly 
independent columns of A which leads to the column parti- 


tion of (LPC): 


min Cx 


subject to Ax 


I 


b => [BIN] x 


I 


Bx, ate NAY = 


The variables x, are called basic (or dependent) 
with coefficients B, and the variables Xu are referred to 
as non-basic (or independent) variables with coefficients 
N. It will be convenient to index columns of B and the 
basic variables X, by the row to column mapping J5 (Geer 
row 1, the associated peace column and variable is Jee 

Ze Basic Solution 

A basic solution at any iteration consists of the 
values of xX, and Xe The value of each of the Xa variables 
is, by convention, a constant equal to zero or the asso- 
ciated upper bound. For illustration, we will assume all 


non-basic variables are at zero. 


The values of the basic variables X_, are defined by 


B 
the problem statement (LPC) as follows: 
Since BX, + NX = 5b 
= -1 -1 
then Xe = Bb B NX, 
and x = 0 => x, = B +b ; 





The value of the objective function is defined: 


cx = Cpxp + Cyan 
ea B7 +p + c.__X 
B N N 
and again 
= -l 
Xu oe = Cx = cB DSi 


eee Ee riceout 
time purpose of the “priceout step" is to identify 
a non-basic variable for which the rate of improvement in 
the value of the objective function is favorable. 


Consider: 


cx = CaxXp +r Cyt 
= -1 -l 
= Cp(B b B NX) + Cyn 
S -1 -1l 
= ChB b + (cy CRB N)Xy 
3 2 eee 
B N 


Note that cB 


tive function given xX =) 0 -and (Cr = c,B “N) is the vector 


b is the current value of the objec- 


of reduced costs, r, which indicates how much the objective 


function changes as X,, changes, This vector, r, will be 


N 
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searched to determine which variable, a will enter the 
basis. The subscript, q, indexes the column chosen. 

If no favorable price is found in this search, an 
optimal solution is declared for the current objective. 

4. Ratio Test 

The “ratio test” insures that the subsequent solu- 
tion will continue to satisfy all variable bounds. The 
ratio test searches for the first variable to reach one of 
its bounds as Bs increases in magnitude. If basic variable 
re ls the variable which first reaches a bound, 0 or UB. 
ee erms of the incoming variable San then Xo leaves ee 
basis and Be enters. Otherwise, Ss reaches et own opposite 
bound before any basic variable does, and Be will not enter 
the basis. 

Let Y = ge represent the updated values of the 


elements of the matrix A, with be denoting column 7, such 


emat : 


Y. = B a “updated column", 


"4 = Bb "Engnt Hamad side” . 


and recall that the basic variables are determined by: 


a il a) 
Xp = B b B NAL 
-1 -1l 
= 8 bee B =e 
qq 
= Yo = Y x — ee) 
0 Sie | Bg 





Then the variable which exits the basis is determined by: 


MIN a) UB, upper bound on entering variable 
b) min tay Lage Vee 0 


e) min(y., - UB 


3.7 eer Ue finite and 


Let p be the index of the constraint in which 
the "winning" ratio is found so that p = % in case a), 
and x. is the leaving variable in cases b) orc). If 
p= 9 Bad pea = ©, then the problem is unbounded: no 
variable reaches a finite bound as a increases and the 
value of the objective function increases without limit. 

SB. Reflection 

We have assumed for convenience that Xu SiO; 

Suppose that x. HomoOuUnded SO that 0 < BS Ss AG and that 


B. 
Then to preserve Xe = 0 and avoid complication in the logic 


at some point Ks leaves the basis at its upper bound, UB... 


required to handle this new type of variable, we "reflect" 
the variable ne 
The variable SE is replaced by UB. - Sy < We will 


J 
record this replacement as a status of the variable Ba 
(noting that another reflection of x, restores its initial 
status), and take care to modify the right hand side with 


the constants sss Ue and treat column j as if its sign 


were reversed. 
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6% Update 


For cases a) andc) of the Tas test, a reflection 
is required in the update. For case a), no further work 
need be done as Ra remains non-basic and B is unchanged. 
Otherwise, in cases b) and c), the variable ioe enters the 
basis and ey leaves the basis. In these cases, an elemen- 


tary transformation matrix Ey must be formed such that 


Ee = Bigiz where Bae is the inverse of the new basis 
with se é€ X, and x. ¢« X,. In this way a "pivot" is per- 


B Jp N 
formed about the element Yong! with: 


1 0 Vi 0 
0 1 V 0 
0 : 
Ey = 1 : 
V : : 

Pp 

1 
0 0 0 V 

m 

where v. = -y. el and v_. = l : 
4 la ee * Pp 5 OOys 


B. TWO PHASE SIMPLEX 

If the initial basis includes artificial variables, 
the initial basic solution may be infeasible. The values 
of these variables must be reduced to zero to obtain a 
feasible basic solution, if one exists. Phase I of the 
two-phase simplex method accomplishes this task. If 


Phase I produces a feasible solution, the original (LPC) 
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objective function is.restored and Phase II is begun. Phase 
II improves a basic feasible solution to optimality. 

The first step in Phase I is to introduce a special 
objective function. This vector contains a zero for each 
non-artificial variable and positive unity as a penalty for 
each artificial variable in the initial basis, so that 


meen onoyective function is of the form: 


Phase I objective: 


MIN (sum of the artificial variables). 


The simplex technique is then applied until the priceout 
step produces no favorable (incoming) variable. At this 
point an optimal solution to the Phase I problem is obtained. 
If the optimal value of the Phase I objective function is 
Mero, the artificial variables all have zero value and the 
associated basis provides a feasible solution to the 
Original problem (although not necessarily optimal for (LPC)). 
If, on the other hand, the final value of the objective 
PanGeE1On 1S positive then not all of the artificial varia- 
bles have a value of zero. Thus a feasible solution to 
(LPC) does not exist, and hence none exists for (LPF). 

During Phase I, an artificial variable, once removed 
from the basis, is never allowed to re-enter. When (LPC) 
contains redundant constraints, artificial variables may, 


with value zero, remain as part of the basic set of variables 


a 





at the end of Phase I [Ref. 1, p. 103]. It is necessary 

that their values in Phase II never exceed zero. This is 
accomplished by eliminating all non-basic variables whose 
reduced costs, ee at the end of Phase I are greater than 
zero, for if one of these variables were introduced into 

the basis during Phase II, the value of some basic artificial 
variable would increase and the solution would again become 
infeasible. Once this task is completed we are guaranteed 
that if artificial variables form part of the basic set of 
variables in the various iterations of Phase II, their 

values will never exceed zero. (See proof; [Ref. l, p. 103].) 
Also, during Phase II, an artificial variable is never 


allowed to re-enter the basis. 


C. A BOUNDED VARIABLE SIMPLEX TECHNIQUE 
1. Transformation of Variables 
A “bounded-variable" problem may include non-zero 
lower bounds on values of variables. Since the algorithm 
adopted assumes all lower bounds are zero, a transformation 
of variables must be carried out prior to the simplex 


routine: 


and requires the following additional bookkeeping: 
a. For all variables with non-zero lower bounds, LB, 
modify the upper bound, UB, such that the modified 


upper bound MUB = UB - LB. 
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b. Modify all right hand side values such that 


Dae oe) ase < LB. | for all a. 
a Joe pe igs 7) 
J 
A retransformation will be required to express the 

solution in terms of the original problem statement. Let 

b' represent the right hand side value of the transformed 
problem at completion of the simplex algorithm, and Xs repre- 
sent the value of the j-th transformed variable. Then 


the transformations required to arrive at the solution to 


the original problem statement are as follows: 


isa Be is non-basic then Ks = ae or OEE + LB.) 
dependent on whether the variable Re 1s at its lower or 
upper bound. 


~Aw 


Wag ae is basic then the following cases apply: 


CASE (LPF) bounds (LPC) transformation 
IL 0 > oe a. Sa = ee 
er J J 


All logical variables are bounded this way. 


2 -~o < Xs <8 xs. = =X. 


3 Se is a free variable p= = Va 


ae 





4 gene < D 


Z| — 
and x. is not reflected xXx. = x. + LB. 
J a 3) J 

or xX. is reflected - = ne - LE - 

5 as XS x. = x. + LB 
ee J a 
6 -~ < x. <a x. = -(x. + LB.) 
5 es J J a) 


2. The Algorithm 


The bounded variable simplex algorithm implemented 


meomas fOllows [Ref. 4, p. 51]. 


STEP l: (PRICEOUT) Determine the non-basic variable, 


ee @les Wiech 
gq 


-l 
MIN (xr =e Co = Tews pepige =. 0) 
Zo a Cuca Go (aa 


If no such variable exists, stop; the current 


solution is optimal. 


STEP 2: (RATIO TEST) Evaluate the three numbers asso- 
ciated with variable he chosen in Step l. 


a. ae (this bound may be infinite) 


Des min gy ee Vie > 0 


on min(y. 4 = es Mao vive <207 ee finite 


aL BE 
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where UB. is the upper bound associated with the variable 
a 

eiae 1S Dasic) for constraint i. Note that if the upper 

bounds are infinite and there are no tests of type b then 


the ratio test may fail. In this case the solution to the 


problem is unbounded in terms of the incoming variable. 


STEP 3: (UPDATE) Depending on which item in Step 2 is 


smallest, update as follows: 


a. Reflect ea The variable Ne goes to its opposite 
bound. Subtract Te times column q from the right 
hand side. Multiply column gq by -1 and change the 
Sign of the indicator vector element S5 to show that 
7 has been reflected (changed to its opposite bound). 


No pivot is required. 


b. Let p be the minimizing index in (b) of Step 2. 
Then the p-th basic variable returns to its old 


bound. Pivot on the element in row p and column q. 


eee net p be the minimizing index in (c) of Step 2. 
Then the p-th basic variable goes to its opposite 


bound. Reflect = ~ Wiouetrace a from Yoo! where 


P 
UB. is the upper bound associated with the variable 


that is basic for row p; reverse the signs of y_. 


PJy 


and e. (to show the reflection) and pivot on the 


P . 
element in row p and column q. 


REPO tO ofeP 1. 
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Pree eo vo ED SIMPLEX--~PRODUCT FORM OF THE INVERSE 

1. Advantages 

Due to the limited random access memory (RAM) available 
on the eight-bit microcomputer, tableau (matrix) simplex 
methods limit problem size. In order to solve "large" 
problems involving several hundred variables and constraints, 
we must store some of the data "off-line". This is done 


by reading and writing data to non-volatile memory diskettes. 


COMPLETE TABLEAU REPRESENTATION 


2 AN 
I BN B™*b 
) 
ee ON a ee Fag eee Ca er ee | |e nr re — 
i , SHE Iai! 
= i 
= B 8) 19) 
0 on Cp N Cp | 
basic non-basic right hand 
variables variables side 
Paqanee 1c. 


The simplex method using multipliers (DANTZIG) or 
the revised simplex method with product-form inverse affords 
the following computational advantages while providing the 
necessary intermediate data that can be efficiently read 
from and written to diskette data files (see [Ref. l, p. 


ZO) }) 
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a. Less data is recorded from one iteration to the next, 
which permits more significant figures to be carried 
or a larger problem to be solved within the limited 


memory of the microcomputer. 


b. Where the original data has a high percentage GE 
zero coefficients, there are fewer multiplications. 
In the standard simplex method, each iteration re- 
quires the recording of at least (m+tl) (n+l) entries. 
Here, however, by use of cumulative multiplications, 
the amount of recorded information is reduced to 


2m+l entries. 


c. High speed core (RAM) storage requirements are 


reduced. 


Ze Erementar y Matrices 


Consider the tableau represented in Figure l, and 
Suppose Y is transformed by a pivot operation where the 


Eervot column is: 


T with pivot element y : 


q ~ ‘Yiqr¥2qr+++'¥mq? pq 


The result of the transformation is the matrix, EY, 


where E is the elementary matrix: 


Se) 





iM 1 : Vy 0 
0 dL a hf 0 
0 
E = al 
V 

Pp 
0 
0 0 0 V ; iE 

m 


where > -y. /Y 


3 al te) 
iq/Ypq’ 7 * P and v,, /Y og 


Now, since the elementary matrix, E, is determined 
entirely by the elements of the pivot column, the remainder 
comprising the identity matrix, all that must be stored is 
the pivot row index number and the associated column vector. 
At any intermediate iteration, k, the product of these ele- 


mentary matrices represents the inverse of the basis: 


(ee aoe 


where Ex is the elementary matrix corresponding to the 


=a Divot Operation. 


Now we will augment the algorithm previously stated. 


; a ee 
1. Since the basic solution X, = eee (BE, (Ey 4 


we can maintain X., current at each iteration by 


Simply multiplying (on the left) by the new elementary 


(...E,b))), 


Matrix for that iteration. This information is used 


in Step 2 and is represented by Yo° 


2. Calculating current relative costs, r= co, - coe N 


can be represented by 
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where 


= cl Be ("simplex multipliers") 


(( (CLE | ae 


ii ie 2 


3. Once the pivot column is chosen, the current values 
Srecre Clements Of that column are required for Step 


Ze Calculate: 


Y, = (EB, (Ey) ++. (BA) ; 
E. DEGENERACY AND CYCLING 
Degeneracy 1s encountered when one or more of the 


-1, 


elements of the current solution (right hand side), B 
become zero. Thus it 1s possible that more than one basis 
has the same coordinates, X. When degenerate solutions 
occur, we can no longer argue that the simplex procedure 
will necessarily terminate ina finite number of iterations, 
as is true in the non-degenerate case [Ref. l, p. 100], 
because the value of the objective function will change by 
an amount equal to zero and it is conceivable that the same 
set of basic variables may recur. If we were to continue, 


with the same selection of x andx. for each iteration as 


before, the same set of basic variables could recur after 
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kK iterations, and again after 2k iterations, etc., indefintely. 
Ties recurrence of the same basis is called "cycling", 
(Ref. 6, pp. 68-69]. We choose to proceed with an algorithm 
Eidtimadees not allow cycling. 
Pivot selection rules exist which ensure completion 

of the simplex method within a finite number of iterations. 
The rule referred to by Bland as "a simple finite pivoting 
rule" [Ref. 3] is stated as follows: 

1. Among all candidates to enter the basis, select the 

variable Ae having the lowest index, i.e., pivot on 


the column gq determined by: 


= minty).: nde 0} 


Yo j 


g 
2. Among all candidates to leave the basis, select the 
Variable x. having the lowest index, i.e., pivot in 


the row p determined by: 


y Y; 
p = min{s: y SO eend _S0 . min{—?: y.._ > OF} 
i Sq Yig *q 


Since we have added a second possible pivot option in 
the bounded variable simplex method, we must modify this 


last statement as follows: 


Yio U8: 
hae YsQ __._s-* 40 Ji. 
p = min{s: — = mini—: Va 0 ert 
Ysq Yig q Yig 
ee 0) 
Yig ’ y 
Ube finite 
Ji 
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Note that in either case the row, p, contains the 
first occurrence of the minimum positive ratio. 

It has been shown on small test problems that imple- 
mentation of Bland's rule may cause a significant increase 
in the number of iterations required to complete the 
problem [Ref. 7]. Current research by Brown and Dewald 
[Ref. 8], suggests a hybrid rule that restricts the pricing 
rule only when the current solution is degenerate. Looking 
again at Step 1 of this rule we will expand the procedure 
as follows: 

a. Define a permutation set of the column indices: 


K = {k Kepeees kt, with a partition after Ke. 


ere 


b. Assign the partition boundary s = 0. 


c. If the minimum positive ratio encountered in Step 2 
of the previous pivot is non-zero, indicating that 
the current solution is non-degenerate, set s = 0 
and select the variable he by the original most 


negative rule. 


dad. If the minimum positive ratio encountered in the 
previous step equals zero then the current solution 
is degenerate. Select As by Bland's rule #1 such 


that: 


* 1. If s = 0 then gq = = where j 1S minimized: 


MINiG: Yo, <0, Jj = TT Serer oe ae 
g 
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* 2. If s # 0 then select 5 such that g = Sy where 


foeLs Manimsezed : 
MIN{]: Yor. < Cree eee Shy 


On, If MO SUGh Gg exists, then select q such 
that 


Yoq ~ aa ok. “0k, <9, Gg = SH p aos pie 


q 
e. Once the incoming variable has been chosen then if the 
"winning" index, j > s interchange Ke and Koay and 


assign s « stl. 


What we have constructed 1S an ordering of the columns 
of the tableau such that Bland's rule is followed, but its 
pricing restriction is applied only when absolutely neces- 
Sary. In this way "most negative pricing" is allowed 
whenever possible. Now we must reconstruct Bland's procf 
that the simplex method under this rule cannot cycle, hence 


is finite. 


PROOF: 

1. Since the simplex method cannot cycle as long as the 
minimum positive ratio > 0, then monotonicity of the 
objective function value eis that the simplex 
method terminates after finitely many pivots examine 


a finite number of ordered bases. 
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ete taRe Minimum pOSitive ratio = 0, Bland's rule is 
used until: 
i ir the minimum positive ratio > 0. 
pe optimality is verified. 
* iii. primal unboundedness is discovered. 

By Bland's rule this will occur in a finite number of pivots. 

3. Once the pivot is completed for some ratio greater 
than zero, the simplex method can not revisit any 
previous basis. The algorithm has moved to a new 
basis corresponding to an improved value of the 
objective function. 

4. Therefore, the monotonicity of the objective function 
value implies that the algorithm terminates in finitely 


many pivots. 


F. REINVERSION 

A characteristic of the product-form inverse algorithm 
is that with each pivot an increaSing amount of work must 
be done in order to apply the elementary transformations. 
The addition of each elementary transformation vector in- 
creases the number of multiplications in the next iteration 
by as much as twice the number of constraints in the problem. 
At some point it becomes more efficient to replace the list 
of vectors, commonly referred to as (ETA), with a smaller 
set representing the Same basis. 

It is convenient to again transform the right hand side 
b' at this point to accommodate reflections of variables 


with upper bounds as follows: 


Sy, 





meeeor Cach retlected vargable ae: 
b. eb ) a. * ES ong Gl Magy 
J 


where aj, are the original non-zero problem elements. 
Hellerman and Rarrick [Ref. 2], present a statement of 
the reinversion problem as follows: 


- Given--a set of basic variables 


- Find--a set of transformation vectors (ETA) which 
imply the inverse of the basis in such as way as to: 
* a. minimize the number of non-zero elements in 
ETA and 
* be. Minimize the work done in forming the ETA. 


This is, of course, extremely expensive to do optimally. 


Starting with Markowitz's observations [Ref. 9] on 
Minimizing the number of non-zero elements when forming 
the ETA vectors, Hellerman and Rarrick develop a fast and 
efficient heuristic algorithm called the "preassigned pivot 
procedure". This development shows that if the rows and 
columns of the basis matrix can be re-ordered so that a 
pivot sequence can be asSigned progressing down the diagonal 
of the transformed matrix M, where M is lower triangular 
with non-zero diagonal elements, then no additional non- 


zero elements are generated in the ETA representation. 


40 





PREASSIGNED PIVOT MATRIX REPRESENTATION 


Figure 2. 


In general, the lower triangular form cannot be achieved 
but only approximated. Some of the columns of M will have 
non-zero elements above the diagonal. These columns are 
called "spike columns". In fact at some point in the 
process there will usually remain a set of spike columns 
called the "bump" so that the matrix can be represented as 
shown in Figure 2. 

In Sections A and E we have found pivots on the main 
diagonal and all other non-zero elements are below the 
diagonal. Section B has all elements equal to Zero. 
Section C is the bump. 

Note that Sections A and E have zero multipliers as we 
proceed down the diagonal. The major problem, then, is 


the build-up of non-zero elements in Sections C and D. This 
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build-up can be minimized by breaking Sections C and D 

into two or more bumps so that the non-zero build-up occurs 
only in the smaller bumps. The process of selection of 
each spike in the preassignment procedure is to choose the 
next pivot column so that: 

a. when its effect is removed from the row counts 
(number of non-zero elements in each row not already 
assigned to the pivot sequence), it will create a 
maximum number of row counts of unity or, at least, 
as many small row counts become smaller as is 
possible, and 

b. the chosen column can be pivoted as soon as possible 
(thereby being updated by the smallest subset of ETA). 

The concept of a tally function is used in the algorithm 
to effect the above goals. The function is defined by: 

= t, (n) = the number of non-zeros that column n has in 
rows whose row count is less than or equal to k, for 
all n fall columns not already assigned a position 
in the column pivot sequence or designated as a 
spike column}. The (k,n) combination giving the 
maximum t, (n) selects the pivot column. 

Two other considerations are also mentioned in connection 
with the preassigned pivot procedure [Ref. 2]. If during 
the scan of column counts, a column with a count of zero is 
found, then a singularity exists in the current basis. The 


column should be dropped from the basis. Similarly, when 


42 





scanning the row counts, if a row count of zero is found 

in an unassigned row, then the associated constraint is 
redundant and could be removed from the problem or repre- 
sented by a basic artificial with value zero. The other 
consideration is that in computer implementations, if the 
updated pivot element becomes too small (machine zero) to 
be used for a pivot then it is necessary to find an alter- 
nate pivot element. This can be done, in theory, by a 
proper choice of an alternate spike pivot column [Ref. 2] 
(a "Spike swap"). Another method is to use Gaussian partial 
pivoting, find another row in the current column having a 
favorable pivot element and continue. This may 

lead to a compromise of our original goals and 

introduce additional spikes. A third alternative is to 
replace the current basic column with a logical variable 
(unit vector) column having unity in the pivot row. Note 
that this technique may introduce an infeasibility in which 
case a post-reinversion return to Phase I will be required. 
The initial implementation of this system will include all 
three options. Although the "spike swap" technique seems 
to be the preferred procedure it requires updating of 
Mubcapte columns. For this reason the partial pivot proce- 
dure is tried first followed by the spike swap if no non- 
zero elements are found. When both of these techniques 


fail, the unit vector insertion is used as a last resort. 
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IV. IMPLEMENTATION 


The implementation uses a KAYPRO II, 8-bit microcomputer 
with 64K random access memory and two single-sided, double 
density 5-1/4 inch floppy diskette drives. Approximately 
597K of this memory is available for program loading and 
storage of variables. The diskette drives are used for 
subroutine storage as well as off-line storage of the 
problem files and the product-form representation of ig. 

The remaining 7K of internal memory is utilized by the 
operating system. The language in which the code is written 
is a "semi~standard" version of Pascal. The programming 
package, JRT PASCAL version 3.0, is very nearly a complete 
version of Pascal as initially designed by Wirth (e.g., 

[Ref. 10]). The JRT version has numerous extensions that 
make file handling on the microcomputer relatively simple. 
The major disadvantage of this language package [Ref. ll] is 
that the code is never completely compiled and, therefore, 
requires a resident "exec" driver which interprets the semi- 
compiled code. This exec occupies 24K of the usable memory 
and executes less efficiently than completely compiled object 
code. An additional disadvantage of this language-machine 
combination is that the KAYPRO II, without an available 
modification, has a Z-80 processor that runs at a speed of 


only 2.5 MHz. This relatively slow processor speed has an 
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obvious effect on solution times, and motivates the developer 
to organize programs in small, easily compiled externally 


linked Pascal procedures. 


A. DATA STRUCTURES 

The data structures used in this implementation are 
quite simple. They consist of a number of one-dimensional 
vectors of dynamic length, and data files which are recorded 
on non-volatile memory diskettes. The size of the vectors 
is determined by the number of variables and constraints of 
the problem. The size of the data files is dependent on 
the number of non-zero problem elements and the number of 
iterations (pivots) performed. To illustrate the structure 
a listing of arrays and variables follows: 

- Major data types: Listed in Pascal format for con- 
venience, the data types defined as records consist of 
two-dimensional arrays of elements that may be accessed 
with a single "read" statement. This Pascal convention 
is of great value when reading from and writing to 
off-line files. 

* real 
x integer 
* boolean 


* matrix = record 


a: real; non-zero problem element 
ilar: integer; row index of the problem 
element 
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* etavec = record 


Getas: real; non-zero elementary matrix 
element 
1eta: integer; row index of the elementary 


matrix element. 
* ranges = record 
lb, mub: real; lower bound for variable 
modified upper bound 
(UB-- LB) for variable). 
- Array variables: 

* bounds: array of type = ranges; variable bounds. 

* ¢: array of reals; initial cost coefficients. 

* e: array of integers; status of variables, 
basis or non-basic, or removed from consideration 
in the problem. Reflections are indicated by the 
Sign of the element, negative indicating a 
reflected variable. 

“ jbasic: array Of wnteacers; variable basic for the 
each constraint, 

* ka: array of integers; random record number of 
first element of each column. The random record 
number is the location key into a random access 
diskette file and indicates the logical record 
number at which to enter. 

* ke: array of integers; random record number of 


first eta element in the eta vector for each pivot. 


£6 





* kj: array of integers; row number for each 
Danze 


* xb: ,array of reals; .current right hand side, 


* tc: array of reals; current column of the tableau, 


oo 
q 
* tl: array of reals; current simplex multipliers, 
-1 
C28 2 
* rside: array of reals; initial [untransformed] 


EuGita hand side, “bi. 
* unitvec: array of integers; index of original logical 
COLUM TOLeGOW 1 . 
* cycle: array of integers; hybrid Bland's rule 
vector for pricing with degeneracy. 
- File variables: (dimensioned 2 by the number of file 
elements) 
* eta: type etavec 
a B inverse matrix element 
from etavec data type. 
* ele: type matrix 
a problem matrix element 


from matrix data type. 


sa LNPUT 
Input to the problem solver is accomplished through the 
use of three subroutines. These include an interactive 


session, "TYPEPROB", during which prompts are given regarding 
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required data input procedures and options; a module, 
"MODPROB", which transforms the formulation into canonical 
form and sets certain vector parameters, and a "READPROB" 
subroutine which creates the final formatting of the problem. 

Initial problem input may also be created using any 
Simple word processor and the first subroutine, "TYPEPROB", 
may be omitted by menu selection. The format required for 
the file is illustrated in Appendix A. 

The problem data used in the example throughout this 
Chapter is taken from the bounded variable example of 
Luenberger [Ref. 4], page 52. This problem statement is 
included in Appendix A. 

1. TYPEPROB 

This subroutine is designed to create a diskette 
text file of the problem formulation. An interactive, menu 
driven series of prompts is used to explain the input re- 
quirements and options of the input system. Appendix B 
displays a sample input session. 

Upon answering the first question posed by the pro- 
gram with (1), to input a new problem, the user will be 
asked to specify a problem name. This name must be EXACTLY 
@ight characters long. In the current implementation this 
is a file-naming restriction. 

The prompt will then present a series of text pages. 
Appendix B illustrates these pages. When the user completes 
his responses to these questions, a series of requests will 


be presented as follows: 
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INPUT NUMBER OF CONSTRAINT ROWS 
Do not count the objective function. 
The user inputs the integer representation of the 
number of constraint rows of the problem formulation. 
INPUT NUMBER OF VARIABLES 
Do not count logical variables. 
DO NOT count the right hand side as a column. 

At this point more instructions will be given on 
the proper procedure for input of integer and real data 
types. Then, the columns will be accepted from the user, 
one column at a time. The variable associated with the 
column will first be named. This name may contain up to 
5 alpha-numeric characters. The next question posed will 
be a multiple~choice menu of variable bounds for the current 


variable. The choices are: 


(ely) 0 < VAR < infinity 

Peat orinity < VAR < 0 

(3) VARIABLE IS UNRESTRICTED (free) 
(4) a < VAR < b 

-)) a < VAR < infinity 


Moye =intinity < VAR < b 


Simply choose the appropriate category for the 


current variable. If the variable is bounded, then the 
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next entries will be the lower bound entry, and/or upper 
bound entry as appropriate. 

At this time the following "heading" will be pre- 
sented on the screen. 

ROW# / VALUE VAGE OPTIONAL ROW # / VALUE 

Negative row to end column. 

The user is to input the INTEGER row number followed 
by the REAL value of the NON-ZERO element in the specified 
column and row. An additional row number and value is 
allowed as long as the column number does not change. ALL 
GOWS OF THE CURRENT COLUMN MUST BE INPUT AT THIS POINT. 

This includes the objective coefficient for this column as 
well as the coefficients of the column's constraint elements. 
Additionally, more than one objective coefficient may be 
entered at this time. This is to allow for maximum and 
Minimum problems to be entered using the same constraints 
but different objective functions. 

When a -l is entered in the next row entry position, 
the column will be terminated and the next column will be 
presented. When all variable columns have been entered 
the format of the entries will be changed to outline the 
input required for the right hand side entries. This format 


will be: 


For RHS #1, ROW # 1 


ENTER G L Oras 
FOR >= <= = 
FOLLOWED BY: 
<SPACE>, Value Or oko, “RETURN? << 
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This prompt will be presented for each row. The 
next prompt will then ask if another RHS column is to be 
entered. Thus, multiple right hand side columns are accommo- 
dated. In this way multiple problems using the same matrix, 
Peco not need to be re-entered for each objective and 
right hand side that might apply. When no more right hand 
side columns are required the subroutine will terminate and 
the program will request information concerning the objec- 
tive function and right hand side to be considered for the 
imminent solution. 

The file that results from this subroutine is stored 
on the diskette in the form shown in Appendix A. The name 
of the file is B:probname.TMP, where "probname" is the eight 
character name entered by the user. If this file is con- 
structed manually without the use of the subroutine, then 
the appropriate name must be given to the file so that the 
program can find it on the "B:" diskette in the future. 

This file-naming procedure which includes the diskette index 
is not specific to the KAYPRO II but is endemic to 
microcomputers. 

2. MODPROB 

At the termination of the subroutine "TYPEPROB" 
or if the selection is made to re-run a problem that has 
been previously entered, then the subroutine "MODPROB" will 
be called. This subroutine will modify the format of the 


problem file to include only that right hand side and that 
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@e7cetive functaon applicable to thas specific problem. 

It will also add the appropriate logical variables to the 
column list. This new set of non-zero problem elements will 
then be written to a new text file, B:probname.DAT, for 

use. Additionally, the first set of basic variables will 

be listed, by column number, with negative column numbers 
representing artificial variables and indicating that Phase 
I simplex will be required. An example of this DATa file 

1s shown in Appendix C. 

This subroutine also allocates dynamic storage for 
vectors and writes a file listing variable names. The user 
will notice a delay during the time "MODPROB" is working. 

A large portion of that time is due to the naming of logical 

variables. The naming routine is slow in this implementation 

due to inefficiencies in the JRT PASCAL structure (not an 

important consideration in the development of the basic 

algorithms). There are faster ways to name the logical 

variables, but a better method was not found for JRT PASCAL. 
3. READPROB 

This subroutine completes the reading of the problem 
data file into a working file that is random access, 
binary and unreadable to a text editor. This is a fast 
access off-line file from which the appropriate non-zero 
elements of a column can be accessed when a column update 
is required during the simplex procedure. Upon termination 


of the "READPROB" subroutine, the problem has been transformed 
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memecanonleat form and all initial values have been set. 


The problem is now ready for the simplex technique. 


Gee ©£HE PROBLEM SOLVER 

The simplex algorithm implemented is a "textbook" 
Pascal translation of the theory and approach already dis- 
cussed. A modular, procedure-calling technique is used 
which allows compilation of small units of code, linked 
as external Pascal procedures. A short description of 
each procedure follows. 

l. SIMPLEX 

The simplex procedure is the driver for the problem 

solver. It determines the requirement for Phase I or Phase 
II, initializes the required objective (cost) vector and 
calls all of the other procedures directly associated with 
the simplex algorithm. | 

2. PHASET 


This procedure solves the modified problem 


Minimize )} x. 
j artificial 


subject to the given constraints, 


arriving at a first feasible solution. If no such solution 
exists and the problem is infeasible then the most feasible, 
last iteration solution is output and the program is ter- 

mMinated. If a feasible solution is found, then the original 


problem cost vector is restored and Phase II simplex is begun. 
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S. EB@RAan 
The "BTRAN" subroutine calculates the simplex 


multipliers 


using the formula (...(((c,E,) E,_j).--)E,) . 
A copy of the Pascal code for "BTRAN" is included 
in Appendix D as an example of the implementation code. 
4.  CHUZO 
After "BTRAN" computes the simplex multipliers, this 
procedure is called to calculate the current reduced costs 
for all non-basic variables, c,. - AN. In the absence of 


N 


degeneracy the most negative reduced cost over all Xu 1s 
chosen, resulting in the most rapid convergence to the 
optimal solution. In the presence of degeneracy the hybrid 
implementation of Bland's rule number 1 is activated. 

5. FTRAN 


This procedure is called at any time that a column 


Vector Update is required. The function calculates, 


Y = Bota using the formula 
g q 
EB (EL _y | er CE!) ma 
6. CHUZP 


Using an updated column from "FTRAN", "CHUZP" 
determines the pivot row, p, uSing the three-case test 


for bounded variables. 
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72 PivorT 
This procedure is called by the simplex subroutine 
and by the "REINVERT" procedure. Each time "PIVOT" is 
called, an asterisk (*) is displayed on the CRT for refer- 
ence. Each asterisk signifies the formation of one ETA 
vector in the ae product-form. If case a of the bounded 
variable simplex algorithm is encountered and a non-basic 
variable is reflected, (no eta vector is generated), then 
a pound sign (#) is printed in place of the asterisk. 
Ge AREINVERT 
"REINVERT" is a direct implementation of Hellerman 
and Rarick's preassigned pivot procedure with a few modifi- 
cations. Forward pivots are completed as they are assigned 
so that subsequent forward transformations can be used 
immediately to reveal scaling difficulties requiring spike 
Swapping (pivot element too small). Constraint redundancy 
checks are also implemented as described in [Ref. 2], page 


214. 


Pee OU. PUT 

The "FILEOUT" procedure causes the current solution to 
be written to the output file, B:PFI.LST. At program 
termination this text file may be printed using any simple 
word processor. An example of the program output for the 
example problem is shown in Appendix E. 

This procedure reverses most transformations used to 


convert to (LPC). Thus, upper and lower variable bounds, 
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free variables, and the extremal operator (min/max) appear 
Simeenie report as they did in the original formulation. 
Constraints appear with non-negative right hand sides. The 
report also lists reduced costs for non-basic variables and 


dual prices for constraints with structural variables 


basic. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


The simplex implementation described has shown that 
advanced algorithms for linear programming problems can be 
packaged in an easy to use, interactive system on a micro- 
computer. It has also shown that while solution time is 
certainly not on the same order of magnitude offered by 
mainframes, neither is there the cost associated with main- 
frame CPU time-sharing. Reasonable solution time for a 
linear program on a microcomputer might be the length of a 
coffee break. This implementation averages three to four 
seconds per pivot for early iteration pivots and approximately 
5 seconds after thirty pivots. 

A time test was run on a problem posed by MICRO VISION 
(135 Herzel Blvd., Lindenhurst, N.Y. 11757) as an advertise- 
ment for their "MATHEMATICAL PROGRAMMING PACKAGE II". This 
problem restated as a bounded variable problem has 8 con- 
straints and 17 variables, including logicals. The original 
A-matrix is 85 percent dense. Total solution time on the 
KAYPRO-II at 2.5 MHz clock speed was 125 seconds. This time 
included 30 seconds required to write three solutions, Phase 
I, Phase II, and the reinversion solution. Phase I and 
reinversion times were also included in the solution time. 
While these times are not as good as the MICRO VISION time 


published, the limit on the number of variables and constraints 
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Poeeeie MiCkO VISTON version is listed as "100 x 100 on the 
IBM Personal Computer or model XT with 128K memory". The 
Pie On Constraints and variables for the description 
given in this paper has not been reached. The limiting 
factors are the number of elements in the one-dimensional 
vectors required for the underlying data structure and the 
size and density of the diskettes used to store the out-of- 
core files. 

Serial file organization of the problem and eta files on 
diskettes would greatly improve performance. This modifi- 
cation would require organization of these files in "pages" 
of columns to permit efficient serial reading of a (problem 
dependent) set of columns at each diskette access. In 
concert with this modification, partial pricing ("batch 
pricing") would probably improve execution efficiency a bit 
more. Unfortunately, these relatively easy modifications 
require significant redesign of dynamic memory management 
and file handling constraints. These enhancements have not 
been implemented at this writing. 

We hope that the work presented here will further stimu- 
late the development of additional mathematical programming 
software for use on microcomputers. As costs of micro- 
computers continue to decrease while system capabilities 
progress, the operations research community must be prepared 
to take full advantage of the availability and potential of 


these valuable tools. 
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Copies of the PASCAL code and diskettes formatted for 
the KAYPRO II, containing all subroutines may be obtained 


from the author. Please address requests to: 
Major D. W. Theune 


Pave. Boxe: 063 
SpEmmeetelay Vas, USA 22151, 


Sys, 


Sealetgo al yap 
1c 
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minimize 


subject to 


APPENDIX A 


EXAMPLE INPUT FILE 


PROBLEM STATEMENT 


2X1 + X5 + 3X3 = 2X 7 10x, 
x + X3 = X4 + 2X_ = 5 
Xo + 2X3 + 2X + Xe = 9 


mim & fF WwW W NY NHN LH 


XL 
X2 
X3 
X4 
X5 


ee, < tee O) Sk 
5 
i 1 
2 1 
ie 1 2 
3 
fee=—l 2 2 
Ba =2 
Ee 2 ee 
3 10 
led 
leg 
4 
4 
4 
4 
4 


EXAMPLE INPUT FILE 


number of constraints / number of variables 


< no blank space here > 


non-zero problem elements 


format : 
/ optional 
col # / row # / value / row # / value 
< blank space required > 
right hand sides 
rhs # / restriction / value 


< blank space required > 


variable name / type of bounds 
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UB 
UB 
UB 
LB 
UB 
UB 


ail 
X2 
X3 
X4 
x4 
x5 


Ww © NO FF 


< blank space required > 


variable bounds UB = upper or LB 


variable name and value 
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APPENDIX B 


INTERACTIVE SESSION 


CRT SCREEN PRESENTATION 1: 


A>bs exec pfi 
Exec ver 3.9 


DEBUG? 9 = no, 1 = yes 
J 
Do you wish to: 
(1) input a new problem? 
(2) re-run an old problem with modifications? 


TYPE YOUR CHOICE 1 or 2 


1 
‘Input the problem name. 
This name will be used whenever the problem is recalled 
FORMAT : 

enter EXACTLY wight characters. ceccccce 
bounded2 


SCREEN 2 


THIS PROGRAM IS INTENDED TO BUILD A DATA FILE FOR PRESENTATION OF 
A LINEAR PROGRAM TO THE PACKAGE THESIS.PFI 


If you want to continue type "go” and <enter>. 

If you have already entered your data 
or if the data file you wish to use has already been created 
then type “return” and <enter> to return to the main prograa. 


go 
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SCREEN 3 


THIS PROGRAM IS INTERACTIVE: 
PROMPTS WILL BE GIVEN AS FOLLOWS: 


The first two entries will be the NUMBER OF ROWS and COLUMNS. 


Remaining entries will be entered in a modified column input format. 
Columns will be requested in order. ‘ 
You will enter the current row number of the next non-zero value 
and the value associated with that column and row. 


Row # / Value // Optional Row # / Value 
NOTE: 
Current column numbers will be provided. If all rows for the current 


column have been entered, type “~1" for the next row number and the 
column number will be incremented. 


TYPE ANY CHARACTER and <enter> TO CONTINUE 
* 


SCREEN 4 


INPUT NUMBER OF CONSTRAINT ROWS 
Do not count the objective function!!!! 
2 


INPUT NUMBER OF VARIABLES 
DO NOT COUNT LOGICAL VARIABLES!!!! 
and DO NOT ENTER LOGICAL VARIABLE COLUMNS!!! !!! 


DO NOT COUNT THE RIGHT HAND SIDE AS A COLUMN! !!! 
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SGREEN: 5 


YOU WILL NOW BE ASKED TO ENTER THE NON-ZERO PROBLEM ELEMENTS. 
All entries will be entered by column. 
A RESTRICTED number of rows and columns may be entered. 


The first 2 rows of each column represent the non-objective 
rows. All additional rows entered will be treated as additiunal 
objective rows. You will be asked later, which objective function 
is to be considered in a given problem solution. 

A MAXIMUM OF 19 OBJECTIVE ROWS MAY BE ASSIGNED TO A GIVEN PROBLEM. 


SIMILARLY: 


The first 3S columns will be treated as variables. All remaining 

columns will be assumed as independent sets of technological constraints. 
You will be asked later, which of these sets is to be considered for 

the current problem solution. 


TYPE ANY CHARACTER and <enter> TO CONTINUE 


SCREEN 6 (DATA INPUT) 


The following entries may pe placed IN ORDER in any column. 
The following restrictions apply: 


All row numbers must be entered as integers. 
All values must be entered as real numbers as follows; 
9.123 or 2.34 or 34.9 . The decimal must have a preceeding 
and a following.numeral. 


ENTER NOW: 
Current column is 1 
Type up to 5 characters to assign variable name for column 1 


X1 


Choose appropriate variable bounds for variable X1 


LB UB 

(1) 4] <= Xi <= infinity 
(2) —infinity <= Xi <= %] 
(3) X1 unrestricted (FREE) 
(4) a <= X1 <= b 
(5) a <= X1 <= infinity 
(&) “infinity <= X1 <= b 
TYPE (1 or 2 or ..e- 4) 
4 

WHAT IS THE LOWER BOUND? a = LS. 
g 

WHAT IS THE UPPER BOUND? b = UB. 
7 


64 





ROW # / VALUE // OPTIONAL ROW # / VALUE 
Negative row to end column 
1rs 2 
Last row entered was objective row # 1 
-1 
Current column is 2 
Type up to 5 characters to assign variable name for column 2 
X2 


Choose appropriate variable bounds for variable X2 


LB UB 

(1) 4] <= X2 <= infinity 
(2) -infinity <= X2 <= Gg 
(3) X2 unrestricted (FREE) 
(4) a <= X2 <= b 
(3) a <= X2 <= infinity 
(4) “infinity <= X2 <= 5 
TYPE (1 or 2 or ... &) 
4 

WHAT IS THE LOWER BOUND? a = LB. 
od 

WHAT IS THE UPPER BOUND? b = UB. 
19 


ROW # / VALUE // OPTIONAL ROW # / VALUE 
Negative row to end column 
eu 3 i 
Last row entered was objective row # 1 
=| 
Current column is 3$ 
Type up to 5 characters to assign variable name for column “53 
XS 


Choose appropriate variable bounds for variable X3 


LB UB 
(1) g <= X33 <= infinity 
(2) -infinity <= XS <= g 
(3) XS unrestricted (FREE) 
(4) a <= X3 <= Db 
(3S) a <= XS <= infinity 
(4) -infinity <= X3 <= b 
TYPE (1 or 2 or ..- 4) 
4 
WHAT IS THE LOWER BOUND? a = LB. 
Zz 
WHAT IS THE UPPER SOUND? D = UD. 
1 
ROW # / VALUE // OPTIONAL ROW # / VALUE 
Negative row to end column 
tt 2 2 
3s 3 -1 


Current column is 4 
Type up to 3S characters to assign variable name for column 4 
X4 
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Choose appropriate variable bounds for variable X4 


LB UB 
(1) 4) <= X4 <= infinity 
(2) —-infinity <= X4 <= DB 
(3) X4 unrestricted (FREE) 
(4) a <= X4 <= b 
(3) a <= X4 <= infinity 
(6) -infinity <= X4 = b 
TYPE (1 or 2 or ... &) 
4 
WHAT IS THE LOWER BOUND? a = LB. 
2 
WHAT IS THE UPPER BOUND? b = UB. 
5S : 
ROW # / VALUE // OPTIONAL ROW # / VALUE 
Negative row to end column 
~t-t 22 
oo—2 tl 


Current column is 5 
Type up to 5 characters to assign variable name for column 5 


Choose appropriate variable bounds for variable X35 


LB UB 
(1) s) <= XS <= infinity 
(2) “infinity c= XS <= 6 
(3) X5 (unrestricted (FREE) 
(4) a <= XS <= b 
(5) a <= XS <= infinity 
(6) “infinity <= XS <= b 


TYPE (1 or 2 or ..- S) 


4 
WHAT IS THE LOWER BOUND? a = LB. 
o 
WHAT IS THE UPPER BOUND? b = UB. 
3 
ROW # / VALUE // OPTIONAL ROW # / VALUE 
Negative raw to end column 
ie 2.2.1 
3 19 -1 


Current column is RIGHT HAND SIDE # 1 


All rows of RIGHT HAND SIDE require an entry. 
ENTER type of constraint follawed by the value of the current RHS. 
ZERO VALUES AS 9.gG 


For RHS # 1, ROW # 1 
ENTER G i or E- 
FOR >= <= = 
Follawed by: 
<SPACE> , value of RHS , <RETURN>.. 
es : 
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For RHS # 1, ROW # 2 
ENTER G Ll or 
FOR >= <= 


am 


Followed by: ; 
<SPACE> , value of RHS , <RETURN>.. 


eg 

RHS 1 is complete. Do you have another RHS column? (Yor N ) 
( Yorn ) 

n 

Is the objective to be MINimized >: aor MAXimized. 

ENTER MIN or MAX 

ain 


Input the integer number of the objective row to be considered. 
This integer must be in the range 1 to 12 
1 


Input the integer number of the Right Hand Side to be considered. 
This integer must be in the range 1 to number of RHS columns. 

1 

Begin phase 1 

###dealing with degeneracy 

#dealing with degeneracy 


Phase I solution complete. s 


Do you wish to print out all intermediate solutions? 
Type any positive integer if YES 
negative integer or 9 if NO 
] 
Begin phase 2 
dealing with degeneracy 
#dealing with degeneracy 
HUH 
Phase II solution complete: 


REINVERSION IN PROGRESS 
4 


REINVERSION COMPLETE 


Program termination 
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Coon nD UW WN & FP W WwW NY F&F HO 


NO FP NY FW FP Ww FF we kr rnd Pe A 


APPENDIX C 


EXAMPLE PROBLEM FILE 


m,n Constraints, variables 


This list is produced by 
the package and is not 


accessible to the user. 


initial basis columns (-) denotes artificials 
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APPENDIX D 


BTRAN PROCEDURE LISTING 


procedure bOtrans 
{produce pricing vector tlCijJ= Cb * Binverse} 


var 
i, j, ki? integers 
tx: real; 


begin 
tor i:= 1 to m do 
begin 
tlicCidjs= cljbasicliljid; 
4# (eCjbasicliJ}<S) then tlCids= -ticilds 
if (abs(t1lCij3)<zl) then tlCijd:= g.G5 
end; 
if (np <> 3) then 
begin 
for 1:= np downto 1 do 
begin 
txs= 8.85 
for kis= kell] to kefCiltiijd-1 do 
begin 
read(binv, rrn, kis eta); 
txs= tx + tlCeta.ietal] * eta.etas; 
end; 
if (abs(tx) < zl) then tx:= 9.95 
tickzjCLIJIs= tx; 
ends 
end$ 
if (debug) then 
begin 
writeln(outfile; *BASIC COST VECTOR’); 
for j:= 1 tom do 
writeln(outfiles t1Cj],” 7)$5 
ends 


end; {procedure btran}. 
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APPENDIX E 


OUTPUT LISTING FOR LP PROBLEM SOLVER 


Output for problem bounded2 
Dealing with degeneracy! 
Dealing with degeneracy! 


Phase I solution : 
The problem is minimize. 


Variable Basic Cl3z] 
Name for initial 
Constraint 
X1 ; 1 5) 
X2 : 2 g 
XS : 5) 
X4 : 4) 
XS : 9 
Row Basic Original 
Variable RHS 
> ie X1 e 3 
2 X2 e 9 


Value of the objective function 


Value 


0. DGADIDAGAGS 
DB. JADGIBDIIGD 
1. DAIIGIIIIIS 
2. DBISIGIIIS 
3. IJOSSISOIISO 


Slack 
Value 


0. SBODIOIIGS 
0. DOGIIOIGOS 


: 4) 


Reduced 
Cost 


DB. DOSADSDIDGS 
9. DIAGDSSIISA 
8. GBGIIIGGIS 
B.9B99995058 
D. GIIAIISAIA 


Dual 
Prices 


9B. DOIABDIIIGD 
0.889909 00099 


Current value and solution represent tableau for pivot # 2 


Dealing with degeneracy! 


Dealing with degeneracy! 
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Optimal phase II solution : 
The problem is minimize. 


Variable Basic Clj] Value Reduced 
Name for initial Cost 
Constraint 
X1 P4 2 7. SAGGIPIISO 2. 2DPBODGIGS? 
X2 : 1 i 1. DIPISAPIIS 9. DYIFBIGIGS| 
XS $ 3 1. DIBDSBIDIAIP 3. BIVIGIIOSS 
X4 - 2 2 3. 9IAIGSIIOSBSP S.DDIISGOSGSS 
XS ; 19 DB. DODPBOSIISP 1. 9BGAPIISOHS 
Row Basic Original Slack Dual 
Variable RHS Value Prices 
1 X2 e 5 DB. DOGOPIAIVS ~4. J2OPIIIIIP 
2 X4 eg DB. DIWOSAGID -1.DISSHIBSD 
Value of the objective function : 12 


Current value and solution represent tableau for pivot # 5 


REINVERSION AFTER PIVOT # 5 


REINVERSION COMPLETE 


ele ip 
initial 


Variable Basic 

Name for 

Constraint 

X1 : ne 
X2 = 2 1 
XS : 3S 
X4 = i -2 
XS : 19 
Row Basic Original 


Value of the objective function 


Variable RHS 


x4 e 3 
X2 e 9 


The problem is minimize. 


Value 


7 - BEDAIBABIP 
1. IBISGAIIGIIS 
1. 9990999999 
3S. DIPAIOSISS 
DB. DIDBOAIIBID 


Slack 
Value 
BS. DIISBPIIAIIGISP 
9. DPPPISIIIO 


: 12 


Reduced 
Cost 


2. SBPGIGIIAISD 
9. DIABOASSIIG 
3. 98I99DGIIIS 
9. GHOADIBIDD 
1. SBGGSIVESO 


Dual 
Prices 


-4. DIIDODIOID 
-1.9SBISBGIIBS 


Current value and solution represent tableau for pivot # 2 
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